Error analysis in anaphora resolution
نویسنده
چکیده
This paper deals with error analysis and their influence in comparative and qualitative evaluation of systems performing anaphora resolution. It presents a corpus-based analysis of errors reported by four anaphora resolution systems, leading to an investigation of the type and source of errors; as a direct application of the investigation’s results, a simple probabilistic hybrid method is described, that takes advantage of the strong points of each of the methods analysed, while trying to avoid their weak points.
منابع مشابه
Error analysis for anaphora resolution in Russian: new challenging issues for anaphora resolution task in a morphologically rich language
This paper presents a quantitative and qualitative error analysis of Russian anaphora resolvers which participated in the RU-EVAL event. Its aim is to identify and characterize a set of challenging errors common to stateof-the-art systems dealing with Russian. We examined three types of pronouns: 3rd person pronouns, reflexive and relative pronouns. The investigation has shown that a high level...
متن کاملRefined Salience Weighting and Error Analysis in Anaphora Resolution
In this paper, the behaviour of an existing pronominal anaphora resolution system is modified so that different types of pronoun are treated in different ways. Weights are derived using a genetic algorithm for the outcomes of tests applied by this branching algorithm. Detailed evaluation and error analysis is undertaken. Proposals for future research are put forward.
متن کاملPronominal Anaphora Resolution for Unrestricted Text
The paper presents an anaphora resolution algorithm for unrestricted text. In particular, we examine portability of a knowledge-based approach of (Mitamura et al., 2002), proposed for a domain-specific task. We obtain up to 70% accuracy on unrestricted text, which is a significant improvement (almost 20%) over a baseline we set for general text. As the overall results leave much room for improv...
متن کاملExperiments and Analysis of LCC ’ s two QA Systems over TREC 2004
In 2004, LCC has participated to TREC QA with two systems; PowerAnswer 2 and PALANTIR. The goal was to study the contribution of new features such as: (1) an improved passage retrieval module based on the Lucene IR system, (2) multiple QA strategies with voting across strategies, (3) the use of text semantic relations, (4) a new method for extracting lexical chains, (5) new logic prover reasoni...
متن کاملUsing Latent Semantic Analysis for Pronominal Anaphora Resolution
This report presents a pronominal anaphora resolution algorithm that uses lexical knowledge (a.k.a. world knowledge) in the process of resolution. We use Latent Semantic Analysis (LSA) as the implementation of lexical knowledge. The algorithm is fully implemented and an automatic checking procedure is applied to assess its performance. We compare it to two other algorithms: a baseline algorithm...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002